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(57) ABSTRACT 

A system for processing data packets in a data packet network 
lias at least one input port for receiving data packets, at least 
one output port for sending out data packets, a processor for 
processing packet data, and a packet predictor for predicting 
8 liiture padcet based on a received packet, such that at least 
some processing for the predicted packet may be accom- 
plished before tiie predicted pactet actually arrives at the 
system. The system is used in preferred embodiments in 
Internet routers. 
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DESCRIPTION OF THE PREFERRED perhaps periods of idleness. These periods of low workload 

EMBODIMEr^ and idle times are unavoidable in the current art. The goal of 
the present invention is to utilize low workload and idle times 

As described in the background section of this specifica- for speculative data processing on fijture data packets yet to 

tion, current art packet processors, operating typically in data S arrive. 

routers, o perate only on packets received to be routed. The piG. 2 is a block-diagram iUustraling components of a 

r mveatoi^ accordins to an embodiment of the present inven- novel network processing system according to an embodi- 

tion, provides an apparatus and method that mables a proces- of the present invention. In this example, a packet buff- 

sor to predict characteristics of a next incoming data packet ering system 201 is provided with a capability of predicting 

and initiate speculative processing before the actual next lO characteristics of some data packets before they arrive to the 

packet arrives for processing. The method and apparatus of processing system. System 201 comprises queues 104fl-» as 

the present invention is described in enabling detail below. described with reference to FIG. 1 above. Direction logic 102 

FIG. 1 is block-diagram Ulustrating components of a typi- and selection logic 105 are also present in this example as is 

cal network processing system according to prior-art. A processing core 106, and these elements are analogous to the 

packet buffer or queuing system 101 is illustrated in this 15 components with the same element numbers previously 



described. 

Packet Pre- 



tion logic block 102 adapted for receiving data packets at dictor202 is provided within system 201 and enables predic 

mgress arid detemumng which of a pli^lity of data queues j^,^ ^^^^^ characteristics before some packets actu- 

will be selected for holdmg the packet data pnor to process- 20 g„ ^ processing system. Data 

mg. to this example there are a plurality of logically-illus- j^^^ ^^^^^^ 202 is a front-end hardware implementation 

trated queues 104a. 104i to 104«. It will be appreciated by speculative packet information for a virtual 

one with skill m the art of data processors that there typically j^^j (predicted data packet). A packet prediction may 

may bemoie than three queues assoc^ted with a data packet triggered by any one of several events and conditions, such 

processor used for data routmg on a data network 25 asdetectionofidleprocessortime.Agoodtime.however.and 

In flus example, an mcommg d^ta packet labeled Packet ^ ^ ^ ^ ^^^^^^ embodiment is when a real data 

Info has been entered m queue 104b as mdicated by cross- .^et is received by the processing system. 



hatching. The data actually stored in such a queue can include 
simply packet identifiers and a packet header to be processed. 



Packet predictor 202 has, in this example, a dedicated 



- complete and full data packet. Tlis option is largely 30 memory (MEM) 204 provided therein and adapted to store 
designde^ndant.Thesetofqueuesl04a-Bhasanassodated ^ta regarding real data packets previously pro- 

buffer control logic 103 that is comiected by control path to a "^'^^ ^^T^^f andhistoncal datt about successfiil 
common access path or line shared by each queue. The ^stances of predicted data packets within «iejystem, 
method of control and communication between bufTer logic wherein the speculative jroc^smg results associated with a 

103 andqueuesetl04a-«isonlylogicallyrepiesentedin this 35 P'^'^l^ packet, backed up by a real packe^ were correct 
example Actual physical linl^ ^id stru.Les may vary f ™"8h to send the real packet out of the system reqmrmg 
according to desi^. It will be appreciated by the skilled ^ZZZ^. ° u "f"^l V^^nJ'^A^ 

artisan m multiple ingress ports may share one set of data ^^^'P^^^et. MEM 204 can be a flash type NffiM, ROM, RAM 
queuesl04«-104Bandthatith^as8umedthatdatapacketsare or any oth« type of usabk memory sufBcjem in size^^ 

serially enqueued and dequeued. 40 f 'east a histoncal record covenug a pre-deflned number of 

Selection logic 105 is illustrated within packet buffer sys- packets, 
tern 1 01 and is adapted to manage how processed packets are I" a preferred embodiment, MEM 204 stores a revolving 
selected to be sent out of queue to egress of the processing history record that is updated periodically, whether or not the 
system after processing is complete. Selection lope 105 is processing was "real" or 'Virtual". For example, MEM 204 

illustrated as comiected by control path to a common access 43 n>ay historical data covering the last 10 data packets 
line shared by all of the queues in setl04a-Baswasdescribed received, and also the practical result of the last ten data 
abovewilhiefeiencetodirectionlc)gicl03.Aprocessingcote packets predicted. In other embodiments the histoty record 
106 is illustrated in this embodiment andis adapted to process couW over many more, or fewer data packets, both real and 
data packet information while data packets are in the system. virtual. In an alternative embodiment of the invention, MEM 

Processing core 106 is logically connected through selection so 2*4 may be implemented externally fiom predictor 202 or 
logic 1 05 to queue set 104a-» by a control line. ''"ff'^r system 201, or even externally fiom the router 

In typical prior-art processing, packets arrive through without departing fi?om the spirit and scope of the present 
ingress of the system as illustrated herein by the label Packets invention. For example, MEM 204 may be an assigned por- 
In, and are buffered in any one of queues comprising set tion ofexisting memory within the processing system such as 

104a-n according to direction logic 102. At least a packet 55 queue memory or processing core memory. There are many 
identifier includinga queue address location identifier labeled possibilities. 

herein simply Packet ID is made available to processing core A buffer logic 205 is provided within packet buffering 
106. Core 106 processes the packet information according to system 201 and adapted to control queue-state reporting and 
applicable software. It is noted in this prior-art example that management of queues 104a-n similarly to buffer logic 103 

processing by core 106 cannot begin until an actual data 60 described above with reference to FIG. 1. In this example 
packets or sufScient information of one is enqueued in one of logic 205 is enhanced to manage queue set 104a-R according 
queues 104a-R and is identified and registered within the to additional predictive capabilities of the present mvention. 
system. Logically spiking, buffer logic 205 has control connection 

It is known that data traffic over a data-packet-network toasharedaccesslitteofqueuesetl04a-naswellasacontro] 

such as the Intemet network typically arrives at processors in es and communication connection to padcet predictor 202, 
a series of data bursts. This means that the processing woik- Additionally, there are illustrated connectiQns between buffer 
loadovertimeofcorel06willexperieDcepeaks,valleys,and logic 205 and direction logic 102 and between buffer logic 
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ABSTRACT 



A voice activated camera is described which allows users to 
take remote photographs by speaking one or more keywords . 
hi a preferred embodiment, a speech processing unit is pro- 
vided which is arranged to detect extended periodic signals 
from a microphone of the camera. A control unit is also 
provided to control the taking of a photograph when such an 
extended periodic component is detected by the speech pio- 
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shown in FIG. 2, the camera 3 also includes a microphone 39 periodic sound is present within the detection window repre- 

for converting a user's speech into corresponding electrical seated by the foity-£)ur fiames. 

speech signals; and a speech processing unit 41 which piD- When the extended periodicity determining unit 111 

cesses the electrical speech signals to detect the presence of a detects a sustained periodic sound within the speech signal, it 
keyword in the user's speech and which informs the camera 5 passes a signal to the camaB control unit 33 confirming the 

control unit 33 accordingly. detection.Asdiscussedabove,thecameracontrolunit33 Aen 
controls the operation of the camera 3 to take the photograph 

Speech Processsing Unit at the appropriate time. 

As discussed above^ the speech processing unit 41 is Frame Periodicity Determining Unit 
arranged to detect keywords spoken by the user in order to as those skilled in the art will appreciate, various tech- 
control the taking of remote photographs. In this embodi- ciques can be used to determine a measure of the periodicity 
ment, the speech processing unit does not employ a "convai- of die speech within each speech frame. However, the main 
tional" automatic speech recognition type kqrwotd spotter components of the particular frame periodicity determining 
which compares the spoken speech with stored models to unit 107 used in this embodiment is shown in FIG. 5. As 
identify the presence of one of the keywords. Instead, the shown, the fiame periodic!^ deteimining unit 107 includes 
speech processing unit 41 used in this embodiment is an auto-correlat»)n determining unit 1071 which receives the 
arranged to detect a sustained periodic signal witfam the mput current speech fiame f, Scam the fiaming unit 105 and which 
speech, such as would occur if the us ct gavs the wo rd determines the auto-condationofthe speech samples within 
"cheeeese" or some other similar word, plie inventor j bas &e frame. In particular, the auto-correlation determining unit 
found that because of the strong periodic nature of such a 1071 calculates tiie following function: 
sustained vowel sound, the speech processing unit 41 can still 

detect the sound even at very low signal-to-noise ratios. , (i) 

Thewayinwhichthespeechproces5ingunit41operatesin wTt 2 

this embodiment will now be explamed with leference to '°° 
FIGS. 3 to 7. 

FIG. 3 illustrates the main functional blocks of the speech "''^"^ xQ) is the j'* sample within the current frame, N is the 
processing unit 41 used in this embodiment. The input signal number of samples m the frame, j=0 to N-1 and L=0 to N-1 . 
(S(t)) received from the microphone 39 is sampled (at a rate of The value ofA(L) forL=0 is equal to the signal energy and 
just over 11 KHz) and digitised by an analogue-to-digital jq for L>0 it corresponds to shifting the signal by L samples and 
(A/D) converter 101. Although not shown, the speech pro- correlating it with the original signal. A periodic signal shows 
cessing imit 41 will also include an anti-aliasing filter before strong peaks in the auto-correlation function for values of L 
the A/D converter 101, to prevent aliasing effects occurring that are multiples of the pitch period. In contrast, non-peri- 
due to the sampling. The sampled signal is then filtered by a odic signals do not have strong peaks. 
bandpassfjlterlOSwhichremovesunwantedfrequency corn- piG. 6 shows the auto-correlation function (A,(L)) for a 
ponents. Smce voiced sounds (as opposedto fccative sounds) „f f representing a speech signal which is peri- 
are generated by the .^biation of the user s vocal cords, the and which repeats approximately every 90 samples As 
tT^'ree^rr^rSS^^^^^^^ shown in FIG. 6. the auto-co^elation around™^ 
this embodiment, the bandpass filter 103 is arranged to thevalueoflheauto<oiTdationftncttonat L=90is approxi- 
remove frequency components below 100 Hertz which will "o mately the sameas the value at L=0, mdicating that the signal 
not contribute to the desired periodic signal. Also, the band- " strongly periodic. 

pass filter 1 03 is arranged to remove frequencies above 500 The fundamental fiequency or pitdi of voiced speech sig- 
Hertz which reduces broadband noise fi-om the signal and tais varies between 100 and 300 Hertz. Therefore, a peak in 
thereforeimprovesthesignal-tc-noiseratio.Themputspeech the auto-cotielation fimctkin is expected between L,^=PJ 
is then divided into non-overlapping equal length frames of 45 300 and L^=¥J100, where F^ is die sampling fiequency of 
speech samples by a framing unit 105. In particular, in this the input speech signal. Consequently, in fliis embodiment, 
embodiment the framing unit 105 extracts a frame of speech (he auto-coirelatioa fimction output by the auto-correlation 
samplesevery 23 milliseconds. With thesamplingrateusedin determining unit 1071 is input to a peak determining uni t 
thisembodiment,tijisresultsineachframehaving256speech 1073 which processes the auto-correlation values between 
samples. FIG. 4 illustrates the sampled speech signal (S(n), ^ AS^i^^ wAA^Lhioh) to identify the peak value (ACL;^-^)) 
showii as a continuous sigrial for ease of illustration) and the within this range. In this embodiment, with a samplingrate of 
way that the speech signal is divided mto non-overiapping j^jj 1 1 kHz the value of L^^^- is 37 and the value of 
™ ■ is 111. This search range of the peak determining unit 
AsshowninFIG.3,eachframefi0fspeechsamplesisthen io73 is illustrated in FIG. 6 by the vertical dashed lines, 
processed by a frame periodicity determining unit 107 which ^hich also shows the peak occurring at L;^90. The auto- 
processes the ^eech samples within the ^e to calculate a con^lationvaluesA(0)andA(L^)arethenpassedfromthe 

fricative sounds. The calculated periodicity measure (v,) is 
then stored in a first-in-first-out buffer 109. In this embodi- 
ment, the buffer 109 can store frame periodicity measures for , ^AH^i P) 
forty-four consecutive frames, corresponding to just over one '™ 
second of speech. Each time a new frame periodicity measure 
is added to the buffer 109, an extended periodicity detennin- 6s 

ing unit 111 processes all of the forty-four periodicity mea- where v, will be approximately one for a periodic signal and 

suresinthebufferl09todeteiminewhetiierornotasu5tained close to zero fora non-periodic signal. 



